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ABSTRACT 



In a memory hierarchy system having two or more 
hierarchy storages of different access speeds and pro* 
grams and/or data to be loaded on the hierarchy stor- 
ages, an activity information acquisition unit and a dis- 
play unit are provided lo present information reg arding 
selection of programs and/or data to be loaHed on a 
higher level in memory hierarchy, a unit is provided 
which automatically decides loading of the programs 
and/or data on the higher level and executes realloca- 
tion of the programs and/or data on the basis of the 
information, and a unit is provided which permits the 
user to change the loading by using a user command. 
The user can make full use of these units during execu- 
tion of the memory hierarchy control. In an embodi- 
ment, priority for the programs and/or data to be 
loaded on the higher level is calculated and decided. 
The programs and/or data are written into the real 
storage in accordance with their priority to increase the 
real storage hit rate upon occurrence of a next request 
for loading. 

13 Claims, 10 Drawing Figures 
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recorded, and programs and/or data to be loaded on a 
MEMORY HIERARCHY CONTROL METHOD higher speed hierarchy storage are selected on the basis 
WITH REPLACEMENT BASED ON REQUEST of the recorded information so as to be loaded on the 
FREQUENCY higher speed hierarchy storage of the memory hierar- 



chy in advance. 
BRIEF DESCRIPTION OF THE DRAWINGS 



BACKGROUND OF THE INVENTION 

1. Field of the Invention 

This invention relates to a memory hierarchy control FIG- 1 is a schematic view of a memory hierarchy 
method for computers which is particularly suitable for control system according to an embodiment of the in- 
a large scale computer system wherein the request fre- 10 vention; 

quency of duplex loading of programs and/or data is FIG. 2 shows various units participating in the mem- 
high and a memory hierarchy is provided which con- ory hierarchy control and processing associated there- 
sists of a real storage of large capacity, a disk/cashe unit with; 

and a disk unit. FIG. 3 shows a management table used in the raem- 

2. Description of the Prior Art * 3 ory hierarchy control system according to the inven- 
In the past, programs and/or data to be written into a tion; 

real storage are transferred from a peripheral storage to FIGS. 4 to 7 are flow charts useful in explaining the 
the real storage when a request for loading of the pro- present invention, of which FIG. 4 is a flow chart when 
grams and/or data occurs. Consequently, the execution a request for execution of a program occurs, FIG. 5 is a 
tune for one program is prolonged and the amount of 2° flow chart illustrative of a reallocation processing, FIG. 
input/output transfer increases the danger of causing 6 is a flow chart illustrative of a processing for speci- 
frequent occurrences of bottleneck at the input/output fying/releasing by a user command the programs and- 
cnannel. . • ^ » t , /or data residing in a real storage, and FIG. 7 is a flow 

Analogous to the present mvendon, a technique has cha rt ulustrative of a processing for specifying/releas- 
available wh^ 25 . ^ ■ ^ data 

in a virtual memory system are made virtual and pro- * f llfMl-r , • V 6 

grams and/or data ar^ loaded on a real storage in ad- ™%£ U * Und ? me ? OTy * lcracl W e . , 

vance. This technique, however, lackTa Unction char- FIG. 8 is a flow chart illustrative of a processing of 
acteristic of the pUnTmtem^ * C "TT * '• mg J* ^ 

information for memory hierarchy control is acquired, 30 *e real storage in accordance with priority; 
such an allocation in a real storage as for reducing the FIG. 9 is a graph for comparison of priority for real 
physical input-output is automatically decided and exe- sto f?£ c * nte sues of from 20 to 40; and 

cuted on the basis of the activity information, and the FIG * 10 18 a S 1 * 1 * for of priority for real 

activity information is displayed to permit the user to stora « e ^ data having sizes of from 1 to 60. 
specify particular programs and/or data residing in the 35 DESCRIPTION OF THE PREFERRED 
real storage. For this reason, this prior art technique is EMBODIMENTS 
disadvantageous in that efficient use of the real storage 

is restricted and reduction effect of the physical input- Th e invention will now be described by way of exam- 
/output is poor. pic* 

In paging processing, on the other hand, a page re- 40 /ftpqt PMnnniMPNm 

placement algorithm such as a least recently used (FIRST EMBODIMENT) 

(LRU) method or working set method is used wherein FIG - 1 shows the construction of a first embodiment, 
basically, the reference locality for program execution In tnis embodiment, real storages 102 and 103 are pro- 
is utilized to load the most recently used programs and- vided as high speed hierarchy storages to which a cen- 
/or data on the real storage. In contrast therewith, the 45 tral processing unit 101 is directly accessible and periph- 
present invention is featured in that the size of a unit of era! storages (disk units) 104, 105 and 106 are provided 
transfer left out of consideration in the paging process- 85 low speed hierarchy storages to which the central 
Log (while one page is fixed) is much accounted of in processing unit 101 is not directly accessible. Reference 
priority. numeral 107 denotes a system under memory hierarchy 

SUMMARY DF thp TMVPisinnw 50 controL A memory hierarchy control system according 

SUMMARY OF THE INVENTION to ^ e invention must fulfill the following functions 

The present invention contemplates elimination of (FIG. 2): 
the above drawbacks and has for its object to provide a (1) To determine, whether the programs and/or data 
memory hierarchy control method for a memory hier- being subject to a request for loading are controlled 
archy system having a plurality of hierarchy levels, 55 under memory hierarchy manager; 
wherein programs and/or data of higher priority are (2) To decide the programs and/or data to be loaded 
loaded at a higher speed, and higher level hierarchy on the real storages; 

storage to which a central processing unit is directly (3) To collect activity information regarding the 
accessible, whereby the processing for tran sfer of the memory hierarchy control; 

programs between the hierarchy storages is reduc ed 60 (4) To display the activity information by a user com- 
&i fd the execution sp eed of the programs is increased to mand; and 

ultHna^y_raJucc the exeCUUojLlte^ (5) To specify/release the programs and/or data re- 

To accomplish the above object, according to the siding in the real storages and to specify/release the 
invention, in a memory hierarchy system having two or programs and/or data controlled under memory hierar- 
more hierarchy storages of different access speeds and 65 chy manager by the user command. To realize these 
programs and/or data loaded on the hierarchy storages, functions, a management table is prepared which indi- 
the loading request generation to the programs and/or cates under what status the memory hierarchy control 
data during operation of the system is monitored and currently manages individual programs and/or data 
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(FIG. 3). The management table contains names of the grams and/or data of lower priority, while loaded on 
programs and/or data, and information regarding posi- the real storage, are extracted. 

tions of the programs and/or data in the peripheral The reallocation execution unit exchanges the pro- 
storages. Additionally, when the programs and/or date grams and/or data of lower priority extracted by the 
arc loaded on the real storages, it can be specified by the 5 reallocation decision unit with the programs and/or 
user command whether the programs and/or data are date of higher priority in order for thelatter to be writ, 
residing in the real storages or in the virtual storage, and ten into the real storage. In this procedure, date which 
the management table contains a flag indicative of have been updated during their presence in the real 
which attribute the programs and/or data currently storage must be written into the peripheral storages. In 
^e aste™^ J0 ^ Ae exc^geproc^mg the status flag in 

and/or date whichare residing in the virtual storage are the management table indicative of the presence or 
c^enUVpresent in the real storages or not. a flag indie- **sence ^ the programs and/or date in ^^e 
ative of whether the programs and/or date are finally * "P*"* bv mcans of a tnanagement table updatmg 
written into the real storages and then updated, and ^ ^ ^or data residing in the virtual 

pnonty for loading the programs and/or date on the JjJV ^/^^ ^ rcallocation processing but 
real storages. mmmnnt Mmr the programs and/or data residing in the real storage 

Examples of vanous functions of the memory hierar- ^ £T ^ to be always present in the real 
chy control wdl now be detailed ^ e m ^ ^ reallocation proccssing . 

(1) Upon Occur^nceof Request for Execution of ^ (3 f of Activity information Regarding 
Pro-ams and/or Date (FIG 4) Memory Hierarchy Control 

When a request for execution of programs and/or ^ ^ information regarding the memory hier- 
data occurs, the controlling is first put under the control u tQ ^ following ihm pr0CC ed. 

of a unit which determines whether the programs and- • ; 

/or data are to be controlled under memory hierarchy 2J ^ of status of the programs and/or data 

management. In this unit, the management table is re- governed by the periodical timer-interrupt; 

trieved and a determination is made as to whether the ^ Acquisition of user command history; and 
programs and/or date are present in the management ^ Recordation of the fact that a request for locating 
table. If not, the programs and/or data are not under the of ^ programs and/or date occurs, 

memory hierarchy control and they are written into the ^ activity information purporting either of the three 
real storage 103 outside the memory hierarchy control proceedings is outputted to the peripheral storage by 
by means of an ordinary input processor. If present, it is way G f an activity information acquisition unit Of van- 
then determined as to whether the programs and/or ous Q f information described above, the activity 
data have already been written into the real storage information relevant to item (i) is used for the realloca- 
under the memory hierarchy control. If the programs 35 t j on decision unit to extract the programs and/or data to 
and/or data are unloaded on the real storage, the status ^ loaded on the real storage. The activity information 
flag in the management table will be updated and the relevant to items (i) and (iii) is used as a criterion ac- 
programs and/or date will be written into the real stor- cording to which the user determines whether the pro- 
age by means of a reallocation execution unit If the grams and/or data are to be residing in the real storage, 
programs and/or data have already been loaded on the ^ (4) Display of Activity Information by User Corn- 
real storage, the memory hierarchy control will not mand 

proceed and the control is executed by the programs Information specified by a user command is outputted 
and/or data. to enable the user to select the programs and/or date to 

In this case, if the programs and/or data are not under be residing in the real storage from the programs and/or 
the memory hierarchy control and if they are under the 45 data under the memory hierarchy control. Contents of 
memory hierarchy control but unloaded on the real this information mainly correspond to items (i) and (iii) 
storage, the execution time of the programs and/or data above and to current contents of the management table, 
cannot be reduced. However, the programs and/or data and are displayed by means of an activity information 
under the memory hierarchy control and loaded on the display unit 

real storage can be executed as they are, thus reducing so (5) Specifying/Releasing the Programs and/or Date 
the execution time. Resident in Real Storage and Specifying/Releasing and 

(2) Upon Occurrence of Timer Interrupt for Reallo- Programs and/or Date Controlled Under Memory Hi- 
cation (FIG. 5) erarchy Manager by User Command 

Reallocation for deciding what programs and/or date By inputting a user command, the user can specify 
have been loaded on the real storage is periodically 55 particular programs and/or date residing in the real 
started by a timer interrupt, exactly asynchronously storage or release the specified particular programs 
with the loading of the programs and/or date. This and/or date (FIG. 6). In addition, by using the user 
starting interval is termed reallocation interval. When command, programs and/or data which have not been 
this processing is started, the controlling proceeds to a controlled under memory hierarchy manner can be put 
reallocation decision unit. The reallocation decision 60 into the management or the programs and/or data 
unit calculates from current contents of the manage- which have been controlled under memory hierarchy 
ment table and a current activity information history manager can be placed outside the management (FIG. 
priority for individual programs and/or data to be writ- 7). 

ten into the real storage. Then, on the basis of the calcu- The following exemplary illustration specif ying- 
lated priority, only a desired amount of programs and- 65 /releasing the programs and/or date will now be de- 
/or date are extracted from programs and/or data scribed. When the user command is inputted, the con* 
which have higher priority but are unloaded on the real trolling proceeds to a command processor and either 
storage and thereafter, a corresponding amount of pro- specifying the programs and/ or date residing in the real 
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storage or releasing the programs and/or data residing (1) The loading frequency fn of individual programs 

in the real storage is stored. In case where the programs and/or data loaded thus far (that is, pn = fn); and 

and/or data residing in the real storage are to be re- (2) The loading frequency of individual programs 

leased, the attribute flag in the management table is and/or data load on a unit of memory (that is, 

changed. By this, the programs and/or data then be- 5 pn=fn/sn). 

come an object to be reallocated by means of the reallo- Effectiveness of both the factors will be described 

cation decision unit and may possibly be purged out of later. The factor of item (2) above has preferable prop- 

the real storage. In case where the programs and/or crties as follows: 

data residing in the real storage are to be specified, the fProDertv 11 

attribute flag is updated to specify the programs and/or 10 1 J 

data residing in the real storage. If, in this case, the The property relevant to item (2) above has a high 

programs and/or data are not present in the real storage probability of providing a solution which approximates 

they will be written into the real storage. Thus, the optimal selection that maximizes the sum of loading 

programs and/or data in question are put aside from frequencies of the selected programs and/or data. 

reallocation and thereafter residing in the real storage. 15 [Property 2] 

(SECOND EMBODIMENT) When the size sn of the programs and/or data is fixed, 

A second embodiment of the invention will now be the P riorit y relevant to item (2) provides an optimal 

described. The second embodiment is principally simi- solution. 

lar to the first embodiment and is particularly con- 20 [Property 3] 
cerned with decision and execution of programs and/or ___ . , * „ 
data to be loaded on the real storage. The programs , W * ien goading frequency fn of the programs and- 
and/or data to be written in advance into the real stor- /o J" data 18 fwc * * c P™" 1 * relevant to ltem <2) P ro " 
age must be limited to those which are predictably „ optinial solution. . 
expected to be loaded frequently in the near future. But 25 *o evaluate effects of priority according to this era- 
it is impossible to know exactly the request frequency bodmien^ evaluaUon modekare determined in accor- 
for loading of the programs and/or data. Considering *™* wth ^f™*?? of thc Slze f vidiud 
* probability of, L^^j^^i 

^oiybeio^ s^r^ 

? q T my P"*™* A designated mLe/of the 

h t g f T FT"* ? T" proinuns and/or data are generated and compared with 

grains and/or date written ,n the real storage To this 35 *J£ other designated memory capacity in ac- 

end, since the past loading request frequency of individ- cordance with the cases^ 

ual programs and/or data is known, the sum of the past (1) where the loading frequency fn is selected with 
loading request frequencies may be examined in respect preferance to larger values; 

of all sets of programs and/or data selected from the (2) where the loading frequency per unit of memory 
programs and/or data under the memory hierarchy ^ ^ ^ selected with preference to larger values; and 
control and having the total sue which is within the (3) wh^ ^ programs and/or data are select at 
capacity of the real storage, thereby finding out a case random 

Wh £l th K statislical quantity * ™*n«zed- * Analytical results are graphically illustrated in FIGS, 

method, however, requires a great processing time for 9 md 10 . Result8 obtained when the size of the pro- 
its execution and is difficult to fulfill its performance. 45 grams and/or data has a random number of 10 to 20 

A practically feasible method is then conceived (when the variance of size is small) are shown in FIG. 9, 
wherein priority is allotted to individual programs and- and results obtained when the size of thc programs 
/or data and ^ written into the real storage, and sets of and/or data has a random number of 1 to 60 (when the 
programs and/or data are selected from programs and- variance of size is large) are given in FIG. 10. In these 
/or data having higher priority until the total size of the 50 figures, dotted curves particularly represent average 
selected sets reaches the capacity of the real storage. values obtained when the programs and/or data are 
This method can reduce the processing time and is easy extracted at random without taking the priority into 
to P r i ct, f c * . m consideration. As will be seen from FIGS. 9 and 10, the 

FIG. 8 shows proceedings for selecting programs hit rate can be improved by 53 to 80% at the most 
and/or data to be written into the real storage by using 55 where the priority related to both the loading frequency 
the pnonty according to the teachings of this embodi- and loading frequency per unit of memory is used, as 
ment. In a flow chart of FIG, 8, compared to the case where the programs and/or data 

N: the total number of the programs and/or data are extracted at random. Especially, it should be under- 
under the memory hierarchy control, stood that the method using the loading frequency per 

A„: the programs and/or data under the memory 60 unit of memory is the most efficient. It should thus be 
hierarchy control, where n= 1, 2 N, appreciated that the priority having relevancy to both 

sn: size of A m factors provides effective criteria for selection of the 

fn: loading frequency of A„, programs and/or data. 

pn: priority allotted to A«, and As has been described, according to the invention, 

C: capacity of the real storage under the memory 65 programs and/or data of higher priority to be loaded 
hierarchy control. more frequently can be loaded on the hierarchy storage 

The priority to be written into the real storage may be of higher level in memory hierarchy and of higher 
related to the following factors: speed to which the central processing unit is directly 



03/04/2004, EAST version: 1.4.1 



4,703,422 

7 8 

accessible, thereby reducing the execution time of the request generation from a processor when the required 

programs and/or data. Further, the employment of the program and/or data is not on the higher speed hierar- 

memory hierarchy control system of the invention chy storage whereby the processor is accessible 

adapted for automatic execution of reallocation can through the higher speed hierarchy storage, 

prevent degradation of operation capability of comput- 5 4. A memory hierarchy control method according to 

ers and can facilitate the operation of computers by claim 3, further comprising the steps of: 

displaying the activity information and changing attri- presenting information regarding the behavior of the 

bute of the programs and/or data through the use of the recorded programs and/or data to the user based 

user command. In addition, the memory hierarchy sys- upon priority, by preparing a management table, 

tern of the invention systematically manages multiple 10 such that programs and/or data of higher priority 

levels of memory hierarchy typically having different to be loaded more frequently can be loaded on the 

characteristics to thereby provide effective means for hierarchy storage of higher level in the memory 

the maintenance of computers. hierarchy and of higher speed resulting in direct 

We claim: accessibility to a central processing unit, thereby 

1. A memory hierarchy control method for a memory 15 reducing the execution time of the programs and- 
hierarchy system having two or more hierarchy stor- / or ^ta; ^ 

ages of different access speeds, wherein the programs causing the user to select programs and/or data on 
and/or data to be loaded in said hierarchy storages are the basis of the presented information so as to load 
characterized according to their priority, said method ^ selected programs and/or data of higher prior- 
comprising the steps of: 20 j ty on ^ higher speed hierarchy storage, 
monitoring and recording the loading request genera- 5 A mcmory hierarchy control method according to 
tion with respect to the programs and/or data that claim 3 whcrein ^ priority for the programs and/or 
is to be operated in said system to calculate the ^ fe rdatcd to ^ ]oading ucsi freque ncy of indi- 
related priority of said programs and/or data for s ^ ]oaded thus far. 
being loaded into the respective hierarchy storages 25 6 Amemory hierarchy control method according to 
on the basis of said loading request generauon; and claim 5 wherem ^ loadin rcquest frequency is the 
selecting higher prwn^grams ^r^ote Qim)ber of loadin te grated from a prior se- 

«- **» * - *■ - — 

l^lLT^J^tZ^t W^?h»n 30 ^ A memory hierarchy control method according to 

the higher speed hierarchy storage is lower than ^ * programs and/or 

the priority of a program and/or data residmg on rat £ of a lo admfrequest fre- 

the lower speed hierarchy storage, a program and- ""^ . . a . \™ . * . T* . 

/or data onT higher s^ h^archy borage is 4«™y »■ b * 

selected during each predWrnmed execution time 35 ^ ™Vor data loaded m the storage thus far. 

to effect the transfer of the latter program and/or f 8 - A memory hierarchy control method according to 

data into the higher speed hierarchy storage and to ^ wh 5™ ^mtonng is executed by a prev,- 

transfer the former program and/or data into the °usly specified part of a program and/or data of all the 

lower speed hierarchy storage. programs and/or data to be executed in the system. 

2. A memory hierarchy control method according to 40 » A memory hierarchy control method according to 
claim 1, further comprising the steps of: claim 3, wherem said each predetermined execution 

presenting information regarding the behavior of the time has a fixed time interval. ^ j 
recorded programs and/or data to the user based 10 A memory hierarchy control method according 
upon priority, by preparing a management table, to claim 1, wherein the priority for the programs and/or 
such that programs and/or data of higher priority 45 data is based upon the ratio of a loading request fre- 
to be loaded more frequently can be loaded on the quency to a memory size required by individual pro- 
hierarchy storage of higher level in the memory grams and/or data loaded in the storage thus far. 
hierarchy and of higher speed resulting in direct 11. A memory hierarchy control method according 
accessibility to a central processing unit, thereby to claim 10, wherein the loading request frequency is 
reducing the execution time of the programs and- 50 the number of loading requests generated from a prior 
/or data; and selection timing point to the next selection timing point. 

causing the user to select programs and/or data on 12. A memory hierarchy control method according 

the basis of the presented information so as to load to claim 1, wherein the monitoring is executed by a 

the selected programs and/or data of higher prior- previously specified part of a program and/or data of all 

ity on the higher speed hierarchy storage. 55 the program and/or data to be executed in the system. 

3. A memory hierarchy control method according to 13. A memory hierarchy control method according 
claim 1, wherein the tower speed hierarchy storage is to claim 1, wherein said predetermined execution time 
connected to the higher speed hierarchy storage to has a fixed time interval. 

transfer a program and/or data required by a loading • • * * * 
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